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Field of the Invention 



The present invention relates, in general, to noise predictor or canceller 



10 devices and, more specifically, to noise predictors that may be utilized within or in 
conjunction with equalization and trellis decoding to remove, diminish or whiten 
correlated noise for high-speed data transmission in digital subscriber line environments 
with crosstalk. 

15 Background of the Invention 



technologies have emerged to provide increased reliability and robustness of the data 
transmitted and received. One technique that is commonly used to accomplish this is 
trellis coded modulation ("TCM"), where such data is trellis encoded and then mapped or 
20 modulated onto any of various, standardized signaling formats or constellations for 
transmission, such as pulse amplitude modulation ("PAM") or quadrature amplitude 
modulation ("QAM"). 



equalization performance, such data for transmission also may be "precoded" (known as 
25 Tomlinson-Harashima ("Tomlinson") precoding), to provide a pre-equalization 

functionality prior to data transmission. For such precoding, a reciprocal training mode is 
utilized between two data communication devices ("DCDs") which are in communication 
with each other through a communication channel. In this training mode, an equalizer 
within the receiver of each DCD determines a plurality of linear filter coefficients to, 
30 among other things, correct for various channel impairments, such as varying frequency 
responses and various types of noise. Each given DCD then transmits its own, 
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individually determined equalization coefficients, referred to in the art as "Tomlinson" or 
"Tomlinson-Harashima" coefficients, to the other DCD, such that the other DCD then 
may utilize these coefficients in its transmission of data to the given DCD. 

Different equalization and precoding schemes have been utilized or are 
5 being proposed for precoding in various high-speed data transmission systems, and are 
being included as recommendations or standards, such as the T 1.4 18 standard accredited 
by the American National Standards Institute ("ANSI 11 ). For example, for 
communication systems such as high bit rate digital subscriber line ("HDSL") systems, 
no precoding is utilized, while for the next or second generation HDSL as proposed in the 

10 ANSI T 1.4 18 standard, generally referred to as "HDSL2", Tomlinson-Harashima 
precoding is utilized. Tomlinson-Harashima precoding schemes are also utilized for 
systems such as G.shdsl of the International Telecommunications Union ("ITU") 
recommendation G. 99 1.2 and some other forms of digital subscriber line systems 
generally referred to as "xDSL". 

15 Particular difficulties arise in high speed data transmission in 

environments such as xDSL, due to, among other things, the use of cables comprised of 
many sets of twisted pair wires, in which a single twisted pair (two wires) is used for full 
duplex transmission over a given communication channel. In some environments, the 
noise power spectral density may be substantially "white", with noise power distributed 

20 rather flatly across the frequency spectrum. For environments such as xDSL, however, 
with as many as fifty twisted pairs of lines providing service, cross-talk impairments 
become very significant, with significant correlated noise, and having a noise power 
distributed very unevenly across the frequency spectrum. For example, for xDSL 
environments, data reception includes not only reception of a transmitted signal, but also 

25 reception of as many as 49 crosstalk noise contributions and other noise couplings 
between the various pairs of wires. In addition, there is a significant variability in the 
types of anticipated crosstalk. This potential correlated noise poses various unique 
problems for accurate data transmission and reception. 

Another difficulty which arises for noise reduction with xDSL is its use of 

30 trellis decoding. Depending upon the depth of the trace or path back through the trellis, 
such trellis decoding may introduce a significant delay, typically on the order of several 
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(or more) symbol time periods, which cannot be tolerated with prior art noise cancellers 
or noise predictors. For example, in Gadot et al. U.S. Patent No. 5,513,216 and Wang 
U.S. Patent No. 5,604,769, both entitled "Hybrid Equalizer Arrangement for Use in Data 
Communications Equipment", a noise predictor is illustrated for use with an equalizer, 
5 during a training mode prior to data transmission, to determine coefficients for 

transmission-side precoding. Neither the Gadot patent nor the Wang patent, however, 
illustrate or otherwise disclose how such a noise predictor should be used with a trellis 
decoder for ongoing adaptation during actual data transmission, particularly in light of 
the potential delays involved in trellis decoding. 

10 As a consequence, a need remains for an apparatus, method and system for 

correlated noise reduction or whitening, utilizing a noise predictor which may be 
implemented as part of or with an equalizer, to substantially reduce correlated or non- 
white noise in data reception and transmission. Such a noise predictor should be readily 
adaptive, converging quickly to optimal linear filter values without excessive training 

15 time. In addition to providing precoding coefficients, such an apparatus, method and 
system for correlated noise reduction should also provide adaptive functionality during 
data transmission, to adjust to potentially changing noise levels and spectral distributions. 
Such an apparatus, method and system for correlated noise reduction should provide 
noise whitening during data transmission within a system utilizing a trellis decoder, both 

20 with or without transmission-side precoding. Lastly, such a noise predictor should be 
capable of implementation as a linear adaptive filter. 

Summary of the Invention 

An apparatus, method and system are provided for correlated noise 
25 reduction, to whiten additive noise and remove correlated noise from a received signal, in 
a trellis decoding environment, such as second generation HDSL (HDSL2). The 
preferred embodiments operate in two modes, a training mode and a data (transmission) 
mode. 

During training mode, equalization and correlated noise reduction 
30 coefficients are determined utilizing two training error signals, a first training error signal 
and a second training error signal. When data for transmission is to be precoded, the 
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equalization and correlated noise reduction coefficients are transferred to a transmitter, as 
Tomlinson coefficients for precoding. 

During data mode, the equalization and correlated noise reduction 
coefficients continue to adapt to potentially changing noise conditions, utilizing two 
5 additional error signals, a trellis error signal and a tentative error signal. 

More specifically, during the training mode, the preferred apparatus 
provides two functional elements for signal processing for equalization and a third 
functional element for signal processing for noise prediction, to generate corresponding 
coefficients, utilizing the two different training error signals. A linear feedforward 

10 equalizer (LEQ) or filter is utilized to determine a first set of coefficients (a(n)) to 

provide generally pre-cursor equalization and intersymbol interference (ISI) reduction, 
with adaptation to the first training error signal (el(n)). When precoding is to be utilized, 
a decision feedback adaptive filter (DFB) is utilized to determine a second set of 
coefficients (b(n)) to provide generally post-cursor equalization and ISI reduction, also 

15 with adaptation to the first training error signal el(n). A noise predictor or filter is 

utilized to determine a third set of coefficients (c(n)) to provide reduction of correlated 
noise (i.e., noise whitening), with adaptation to the first training error signal el(n), and 
with an input of a second training error signal (e2(n)). For circumstances involving data 
transmission precoding, a fourth set of coefficients (t(n), referred to as Tomlinson 

20 coefficients) are then determined as t(n) = b(n) + c(n) + b(n)*c(n), in which "*" denotes a 
convolution operator. 

The received, equalized and noise reduced signal is then input into a trellis 
decoder, which also operates in a training mode and a data mode. During training mode, 
the trellis decoder utilizes a symbol decider, to provide a symbol decision utilized in 

25 forming the first and second training error signals. During data mode, the trellis decoder 
decodes a received, equalized and noise reduced data signal, to produce decoded data, to 
produce the trellis error signal, and to provide a tentative symbol decision utilized in 
forming the tentative error signal. 

The first training error signal el(n), used for adaptation of the LEQ, DFB 

30 and noise predictor, represents a total residual error remaining in the received training 
signal after both equalization and correlated noise reduction (noise whitening), and is 
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determined as a difference between a symbol decision and the received training signal 
after equalization and noise whitening. The second training error signal, utilized as input 
into the noise predictor, represents the error or noise remaining after equalization only, 
and is determined as a difference between a symbol decision and the received training 
5 signal after equalization (but prior to correlated noise reduction). 

Significantly, and separate and apart from any transmission-side precoding 
with the Tomlinson coefficients, the various embodiments also provides adaptive noise 
whitening during a data transmission mode, with trellis decoding of the received data 
signal. For continued adaptation of both the linear feedforward equalizer and the noise 

10 predictor, the preferred apparatus utilizes a trellis error signal (e3(n - mi)) from the trellis 
decoder, and in addition, utilizes a tentative error signal (e4(n - m 2 )) for input into the 
noise predictor. In the preferred embodiment, mi = m 2 = 1, providing data mode error 
signals having a delay of one symbol time period. 

An additional novel feature of the present invention includes the selection 

15 of the trellis and tentative error signals in a trellis decoding environment. Utilizing a path 
having the smallest cumulative error within the trellis, the apparatus of the present 
invention selects a previous state, and utilizes the decision or branch error (branch or 
decision metric) corresponding to that selected state to form the trellis error signal. In the 
preferred embodiment, the selected state is an immediately previous state (at time t = (n - 

20 1), i.e., mi = 1), to minimize any delay in the adaptation process. 

The tentative error signal is a tentative decision error, and is formed 
similarly to the second training error signal, but having a delay of one symbol time in the 
preferred embodiment. More particularly, the tentative error signal is formed as a 
difference between a tentative symbol decision at time t = (n - m2), and the received data 

25 signal subsequent to equalization and filtering (but prior to additional correlated noise 

reduction) with a corresponding delay of m 2 . In the preferred embodiment, m 2 is also one 
symbol time period, i.e., m 2 = 1. 

The apparatus, method and system for correlated noise reduction of the 
present invention substantially reduce correlated or non- white noise in data reception and 

30 transmission, and provide a significant increase in performance of 1-2 dB. During 

training mode, the noise predictor provides a third level of signal processing to reduce 
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correlated noise, following two levels of signal processing for equalization, and is readily 
adaptive, converging quickly to optimal linear filter values without excessive training 
time, utilizing two distinct training error signals. The various embodiments of the present 
invention provide noise whitening within a system utilizing a trellis decoder, with or 
5 without transmission-side precoding. In addition to providing precoding coefficients, the 
preferred noise predictor of the present invention also provides adaptive functionality 
during data transmission in a trellis encoded environment, to adjust to changing noise 
levels and spectral distributions, utilizing novel trellis and tentative error signals, and is 
capable of implementation as a linear adaptive filter. 
10 Numerous other advantages and features of the present invention will 

become readily apparent from the following detailed description of the invention and the 
embodiments thereof, from the claims and from the accompanying drawings. 

Brief Description of the Drawings 

15 Figure 1 is a block diagram illustrating a preferred apparatus embodiment 

in accordance with the present invention. 

Figure 2 is a block diagram illustrating a transmitter utilizing coefficients 
determined by an apparatus embodiment in accordance with the present invention. 

Figure 3 is a block diagram illustrating a system of data communication 
20 devices for an exchange of correlated noise reduction and equalization coefficients in 
accordance with the present invention. 

Figure 4 is a block diagram illustrating a first preferred apparatus 
embodiment during training mode in accordance with the present invention. 

Figure 5 is a block diagram illustrating a second preferred apparatus 
25 embodiment during data transmission mode, with data transmission precoding, in 
accordance with the present invention. 

Figure 6 is a block diagram illustrating a third preferred apparatus 
embodiment during data transmission mode, with data transmission precoding, in 
accordance with the present invention. 
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Figure 7 is a block diagram illustrating a fourth apparatus embodiment for 
non-precoding data communications applications, during training and data transmission 
modes, in accordance with the present invention. 

Figure 8 is a block diagram illustrating a preferred data communication 
5 device embodiment in accordance with the present invention. 

Figure 9 is a flow diagram illustrating a method embodiment in 
accordance with the present invention. 

Figure 10 is an exemplary graph diagram illustrating improved 
performance and reduced slicer error utilizing the preferred apparatus of the present 
10 invention. 

Figure 11 is an exemplary graph diagram illustrating improved 
performance and reduced symbol error rate under various conditions utilizing the 
preferred apparatus of the present invention. 

Figure 12 is an exemplary tabular diagram illustrating improved 
15 performance margins under various conditions utilizing the preferred apparatus of the 
present invention. 

Detailed Description of the Invention 

While the present invention is susceptible of embodiment in many 
20 different forms, there are shown in the drawings and will be described herein in detail 
specific embodiments thereof, with the understanding that the present disclosure is to be 
considered as an exemplification of the principles of the invention and is not intended to 
limit the invention to the specific embodiments illustrated. 

As mentioned above, a need remains for an apparatus, method and system 
25 for correlated noise reduction, to substantially reduce correlated or non-white noise in 
data reception and transmission. Such an apparatus, method and system for correlated 
noise reduction are provided in accordance with the present invention, which are readily 
adaptive, converging quickly to optimal linear filter values without excessive training 
time, utilizing two distinct training error signals. The apparatus, method and system for 
30 correlated noise reduction of the present invention also provide continued adaptation for 
noise whitening within a system utilizing a trellis decoder, both with or without 
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transmission-side precoding, utilizing distinct trellis and tentative error signals. In 
addition to providing precoding coefficients, the preferred apparatus, method and system 
for correlated noise reduction of the present invention also provides adaptive 
functionality during data transmission, to adjust to changing noise levels and spectral 
5 distributions, and utilize a noise predictor capable of implementation as a linear adaptive 
filter. 

Figure 1 is a block diagram illustrating the preferred apparatus 
embodiment 100 in accordance with the present invention. Such an apparatus 100 is 
generally included within a receiver of a data communication device, as discussed below 

10 with reference to Fig. 3, and is preferably implemented or embodied as discussed below 
with reference to Fig. 8. Additional receiver (or transmitter) functionality, as known in 
the field of data transmission, is not separately illustrated or discussed. As illustrated in 
Figure 1, the apparatus 100 integrates or incorporates equalization functionality, with a 
linear feedforward equalizer or filter ("LEQ") 105, which utilizes a plurality of 

15 equalization coefficients a(n), and with a decision feedback adaptive filter ("DFB") 
(separately illustrated in Fig. 4 as DFB 150), which utilizes a plurality of equalization 
coefficients b(n), and which is incorporated within the training mode adaptive distortion 
and correlated noise canceller 110. The LEQ 105 and DFB 150 are typically considered 
in the art to comprise a decision feedback equalizer. The training mode adaptive 

20 distortion and correlated noise canceller 1 10 is discussed in greater detail below with 
reference to Fig. 4. An additional linear adaptive filter referred to as a noise predictor, 
also within the training mode adaptive distortion and correlated noise canceller 110 
(separately illustrated in Figs. 4-7 as noise predictor 160), utilizes a plurality of correlated 
noise reduction coefficients c(n). The various coefficients a(n), b(n) and c(n) are 

25 determined during a training period, based upon the transmission of a training signal as 
utilized in the prior art, such as a psuedo-random signal consisting of scrambled ones for 
xDSL. The various equalizers and noise predictor (such as LEQ 105, DFB 150 and noise 
predictor 160) have corresponding transfer functions A(z), B(z) and C(z), which are z- 
transforms of the coefficients a(n), b(n) and c(n). 

30 As discussed in greater detail below, the preferred apparatus embodiment 

100 utilizes three separate functional elements (or functional blocks) for signal 
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processing during training mode to provide equalization (first and second functional 
elements) and noise whitening (correlated noise reduction) (third functional element). 
The first functional element for signal processing, implemented by LEQ 105 preferably 
as a fractionally-spaced adaptive feedforward filter, generally reduces pre-cursor ISI 
5 (and, to some degree, post-cursor ISI). The second functional element for signal 
processing, implemented by an adaptive feedback filter (also referred to as a decision 
feedback adaptive filter) within the training mode adaptive distortion and correlated noise 
canceller 110 (such as DFB 150 in Fig. 4), generally reduces post-cursor ISI. The third 
functional element for signal processing, implemented by a noise predictor within the 

10 training mode adaptive distortion and correlated noise canceller 110 (such as noise 
predictor 160 in Fig. 4), generally removes correlated noise and whitens the noise 
spectrum. As discussed in greater detail below with respect to Figs. 4-7, the present 
invention utilizes four different error signals to achieve such equalization and noise 
whitening, two different error signals during a training mode, and two different error 

15 signals during a data transmission mode. 

The preferred apparatus embodiment 100 of Fig. 1 operates in two modes, 
an initial training mode, followed by a data transmission mode. (For ease of reference in 
Fig. 1, components of apparatus 100 which are utilized only during data transmission 
mode are illustrated utilizing dashed lines). During the training mode, the training mode 

20 adaptive distortion and correlated noise canceller 1 10 is operational, while filter 120, data 
mode adaptive correlated noise canceller 130 and decoder functionality (within trellis 
decoder 140) are bypassed, with only a symbol decider functionality (without decoder 
functionality) utilized within the trellis decoder 140. During data mode, filter 120, data 
mode adaptive correlated noise canceller 130 and the decoder functionality of trellis 

25 decoder 140 are operational, while the training mode adaptive distortion and correlated 
noise canceller 1 10 and symbol decider functionality (of the trellis decoder 140) are 
bypassed or non-operational. For both training and data modes, the output of the trellis 
decoder 140 is a best estimate of the transmitted symbol and has a transmission delay of 
M p" symbols (d'(n - p)). Additional variations are illustrated for data modes in a 

30 precoding environment (Figs. 5 and 6) and in a non-precoding environment (Fig. 7). 
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Referring to Fig. 1, a received signal, typically with intersymbol 
interference ("ISI") and with additive noise such as crosstalk and residual echo (r(n) + 
n(n)), is sampled (115), preferably at a rate of k/T (where 1/T is the data symbol rate (T is 
the data symbol period), and k is a positive integer greater than one, with such sampling 
5 also referred to as "fractionally spaced" sampling), but equivalently may also be sampled 
at a rate of 1/T. The sampled (k/T or 1/T) signal is input into LEQ 105 for initial 
equalization to remove predominantly pre-cursor intersymbol interference (ISI) (with 
transfer function A(z) and coefficients a(n)). In the preferred embodiment, if the received 
signal was sampled at a rate k/T (with k > 1), then the output of LEQ 105 is down 

10 sampled (125) to a rate of 1/T (referred to as symbol spaced sampling), in accordance 
with the present invention, to provide one sample per symbol time. In data transmission 
mode, the down sampled output of LEQ 105 is further multiplied by the transfer function 
(1 + C(z)) in filter 120 (in which the transfer function C(z) is determined as discussed 
below). In training mode, the filter 120 is bypassed. During the training mode, this 

15 output (from down sampled (125) LEQ 105) is combined (in summer 135) with the 

output of the training mode adaptive distortion and correlated noise canceller 1 10 (having 
transfer functions B(z) and C(z)), with coefficients b(n) and c(n) being trained to 
converge to particular values, for subsequent transmission as Tomlinson coefficients 
(T(n)), as discussed in greater detail below with respect to Fig. 4). During a data 

20 transmission mode subsequent to the training mode, the down sampled (125) and filtered 
(120) output is combined (also in summer 135) with the output of the data mode adaptive 
correlated noise canceller 130, discussed in greater detail below with reference to Figs. 5 
and 6. The adaptive correlated noise canceller 130 is utilized, in the preferred 
embodiment, to continue to allow the apparatus 100 to adapt to potentially changing 

25 noise conditions following training, during data transmission (data mode). 

The output of such combining from summer 135 (referred to as d"(n) and 
w(n) (whitened noise) in Fig. 1) is input into a trellis decoder 140 (which also preferably 
includes a modulo function), to produce a decoded output (d'(n - p) in Fig. 1) in data 
transmission mode. During training mode, as discussed in greater detail below, the 

30 decoder functionality of trellis decoder 140 is bypassed and is replaced by a symbol 

decider (or slicer), such as symbol decider 165 in Fig. 4, to produce estimated decisions 
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(cT(n)) to determine various equalization taps (coefficients a(n) and b(n)) and the 
correlated noise reduction coefficients c(n). 

Continuing to refer to Fig. 1 , and of significance in the present invention, 
the apparatus 100 operates in two modes, a training mode (utilizing the training mode 
5 adaptive distortion and correlated noise canceller 110) and a data mode (utilizing the 
adaptive correlated noise canceller 130). During training, the various coefficients a(n), 
b(n) and c(n) are determined initially. For subsequent precoding during data mode, the 
coefficients b(n) and c(n) are transmitted to a transmitter (Fig. 2), preferably in the form 
of one set of coefficients t(n) resulting from the additions and convolution of b(n) + c(n) 
10 + b(n)*c(n) (or, equivalently in z-transform domain, T(z) = B(z) + C(z) + B(z)*C(z)). As 
discussed in greater detail below, during data mode, coefficients a(n) and an updated c(n), 
c'(n) or c"(n) continue to adapt to potentially changing channel and noise conditions. 
Additionally, in Fig. 7, another data mode is illustrated for use in a non-precoding 
environment. 

15 As illustrated in Fig. 1, four different error signals are utilized in the 

preferred embodiment. Two error signals, first training error signal el(n) 170 and second 
training error signal e2(n) 185, are utilized in the training mode, and two other error 
signals, trellis error signal e3(n - mi) 195 and tentative error signal e4(n - 1112) 215, are 
utilized in the data transmission mode. (In non-precoding data communication 

20 environments, a fifth error signal e5(n - m 2 ) 216 (formed similarly to the tentative error 
signal 215) is used in place of the tentative error signal 215). 

The first training error signal el(n) 170 is used during the training mode 
for adaptation of the LEQ 105, and the DFB and noise predictor in the training mode 
adaptive distortion and correlated noise canceller 110, and represents a total residual error 

25 remaining in the received training signal after equalization and correlated noise reduction. 
The first training error signal el(n) 170 is determined as a difference between a symbol 
decision (from trellis decoder 140) and the received training signal after equalization and 
correlated noise reduction (illustrated in greater detail with reference to Fig. 4). The 
second training error signal in training mode, utilized as input into the noise predictor in 

30 the training mode adaptive distortion and correlated noise canceller 1 10, represents the 
error or noise remaining after equalization only, and is determined as a difference 
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between a symbol decision and the received training signal after equalization (but prior to 
correlated noise reduction). 

Significantly, and separate and apart from any transmission-side precoding 
with Tomlinson coefficients, the apparatus 100 also provides adaptive correlated noise 
5 reduction during a data transmission mode, with trellis decoding of the received data 
signal. For continued adaptation of both the linear feedforward equalizer and the noise 
predictor, the preferred apparatus 100 utilizes a trellis error signal (e3(n - mi)) (on 
dashed lines 171 and 172), and in addition, for input into the noise predictor of the data 
mode adaptive correlated noise canceller 130, the preferred apparatus 100 utilizes a 

10 tentative error signal (e4(n - m 2 ) or e5(n - m 2 ) on dashed line 173). In the preferred 
embodiment, m\ = m 2 = 1, providing data mode error signals having a delay of one 
symbol time period. The use of the trellis and tentative error signals is discussed in 
greater detail below with reference to Figs. 5, 6 and 7. 

An additional novel feature of the present invention includes the selection 

15 of the trellis and tentative error signals in a trellis decoding environment. During the 
decoding process, the trellis decoder 140 selects a path having a smallest cumulative 
(path) error within the trellis. The trellis decoder 140 of the present invention then 
selects a previous state within that path, and utilizes a branch or decision error 
(represented as a current branch metric or decision error) corresponding to the selected 

20 state to form the trellis error signal e3(n - mi) 195. In the preferred embodiment, the 
selected state is an immediately previous state (at time t = (n - 1), i.e., m\ = 1) to 
minimize delay in the adaptation process. For other embodiments, the selected previous 
state may incorporate greater delay (i.e., mi > 1). 

The tentative error signal (e4(n - m 2 ) 215 or e5(n - m 2 ) 216) is a tentative 

25 decision error, and is formed similarly to the second training error signal, but having a 
delay of one symbol time in the preferred embodiment (i.e., m 2 = 1). More particularly, 
the tentative error signal 215 is formed as a difference between a tentative symbol 
decision at time t = (n - m 2 ), and the received data signal subsequent to equalization and 
filtering (but prior to additional correlated noise reduction) with a corresponding delay of 

30 m 2 symbol time periods. (It should be noted that the values of mi and m 2 may be selected 
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independently, i.e., m\ does not necessarily equal m2 and, moreover, mi should be greater 
than or equal to 1112, for all cases or for all embodiments). 

Also significant in the present invention is the possible use of two 
different sampling rates, fractional rate sampling (k/T, with k > 1) and non- fractional or 
5 symbol rate sampling (1/T), with fractional rate sampling generally for pre-cursor 

equalization, and with non- fractional or symbol rate sampling generally for post-cursor 
equalization and correlated noise reduction. The selection of the value of k (with k being 
a positive integer) depends upon the selected system environment. For example, for 
many environments where a significant portion of the spectrum of the transmitted signal 

10 is less than one-half the sampling rate (the Nyquist rate or frequency), then k may equal 
1 ; conversely, where the spectrum of the transmitted signal is wider, increased 
performance may be obtained when k is selected to be greater than 1. 

In accordance with the preferred embodiment of the present invention, 
therefore, the pre-cursor equalization functionality utilizes fractional rate (k/T) sampling 

15 while the correlated noise reduction and post-cursor equalization functionalities utilize 
the (down sampled) symbol or non-fractional rate (1/T). As a result, all three sets of 
coefficients converge with reasonable rapidity. In addition, use of the correlated noise 
reduction apparatus of the present invention results in an overall gain of 1.5 to 2 dB in 
noise margins in crosstalk environments, and an improved bit error rate (BER) in trellis 

20 code modulation systems which are highly sensitive to correlated noise. 

Figure 2 is a block diagram illustrating a transmitter 200 utilizing 
coefficients determined by an apparatus in accordance with the present invention. As 
illustrated in Fig. 2, a data stream d(n) for transmission (to the apparatus 100) is precoded 
(or predistorted) with the coefficients t(n) resulting from (b(n) + c(n) + b(n)*c(n)) (block 

25 205), followed by modulo function 210, resulting in precoded data p(n) for transmission. 
As discussed below, the coefficients t(n) may be calculated by the transmitter 200, based 
upon b(n) and c(n) transferred from a receiver; or equivalently, a receiver may calculate 
t(n) from the b(n) and c(n) coefficients it has also determined, and transfer the resulting 
t(n) coefficients to the transmitter 200 (as discussed below). 

30 Figure 3 is a block diagram illustrating a system of data communication 

devices 300 for an exchange of correlated noise reduction and equalization coefficients in 
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accordance with the present invention. As illustrated in Fig. 3, during a training mode, 
each transmitter 200A and 200B transmits a training signal to each corresponding 
receiver 1 1 IB and 1 1 1 A, respectively, in the other DCD 300, via a bi-directional 
communication channel 305, such as a twisted-pair cable. For example, the transmitter 
5 200B in DCD 300B transmits a training signal, such as scrambled ones, to receiver 1 1 1 A 
in DCD 3 00 A. The equalizer and noise canceller in the receiver 1 1 1 A, in accordance 
with the present invention, determines coefficients a(n), b(n) and c(n), and further 
determines a set of correlated noise reduction and equalization coefficients (Tomlinson 
coefficients) t(n) equal to b(n) + c(n) + b(n)*c(n). The receiver 1 1 1A then transfers these 

10 correlated noise reduction and equalization (t(n)) coefficients to its transmitter 200 A, for 
transmission over channel 305 to the receiver 1 1 IB of DCD 300B. The receiver 1 1 IB, in 
turn, transfers these correlated noise reduction and equalization coefficients (t(n) = b(n) + 
c(n) + b(n)*c(n)) to its transmitter 200B, for use in subsequent transmissions to receiver 
1 1 1 A. Equivalently, the coefficients b(n) and c(n) may be transferred directly from the 

15 receiver 1 1 1A, with the addition and convolution steps b(n) + c(n) + b(n)*c(n) performed 
by the DCD 300B to determine the coefficients t(n) for use in its transmitter 200B. 

Reciprocally, the transmitter 200 A in DCD 3 00 A transmits a training 
signal, such as scrambled ones, to receiver 1 1 IB in DCD 300B. The equalizer and noise 
canceller in the receiver 1 1 IB, in accordance with the present invention, determines its 

20 own coefficients a(n), b(n) and c(n), and further determines a set of correlated noise 

reduction and equalization coefficients (Tomlinson coefficients) t(n) equal to b(n) + c(n) 
+ b(n)*c(n). The receiver 1 1 IB then transfers these correlated noise reduction and 
equalization (t(n)) coefficients to its transmitter 200B, for transmission over channel 305 
to the receiver 1 1 1 A of DCD 300A. The receiver 1 1 1A, in turn, transfers these correlated 

25 noise reduction and equalization coefficients (t(n) = b(n) + c(n) + b(n)*c(n)) to its 

transmitter 200 A, for use in subsequent transmissions to receiver 1 1 IB. Equivalently, the 
coefficients b(n) and c(n) may be transferred directly from the receiver 1 1 IB, with the 
addition and convolution steps b(n) + c(n) + b(n)*c(n) performed by the DCD 300A to 
determine the coefficients t(n) for use by its transmitter 200A. In general, the sets of 

30 correlated noise reduction and equalization coefficients (t(n) = b(n) + c(n) + b(n)*c(n)) 
determined by each receiver 1 1 1A and 1 1 IB generally will not be identical. 
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Figure 4 is a block diagram illustrating a first, preferred apparatus 101 
during training mode in accordance with the present invention. As illustrated in Fig. 4, 
the training mode adaptive distortion and correlated noise canceller 1 10 includes a 
decision feedback adaptive filter (or equalizer) ("DFB") 150, operational only during 
5 training mode, and a noise predictor 160 (implemented as a linear adaptive filter), 

operational during both training and data modes. The DFB 150 is utilized to determine 
the equalization coefficients b(n), and the noise predictor 160 is utilized to determine the 
correlated noise reduction coefficients c(n). As mentioned above, during training mode, 
the decoder functionality of trellis decoder 140 is not operative and, instead, a symbol 

10 decider (or sheer) 165 (within trellis decoder 140 of Figs. 1 and 4) is utilized to determine 
a value of a given symbol, resulting in a symbol decision d'(n), for each symbol, as a best 
estimate of the transmitted symbol d(n). The LEQ 105 is utilized to determine the a(n) 
equalization coefficients, to eliminate ISI and to determine cursor (or slicer) location (the 
location in a received symbol utilized for sampling and decision). (In the art, LEQ 105 as 

15 an adaptive feedforward filter and DFB 150 as an adaptive feedback filter are typically 
considered to form a decision feedback equalizer (DFE), without any correlated noise 
reduction function of the present invention, however). 

Continuing to refer to Fig. 4, the equalizers, both LEQ 105 and DFB 150, 
and the noise predictor 160, in accordance with the present invention, are each trained 

20 with adaptation to a first training error signal 170, el(n), typically referred to as "slicer" 
error, which is an error signal formed from the difference between the output and input of 
the symbol decider 165, i.e., the difference between the symbol decision (d'(n)) and the 
received training signal after both equalization and correlated noise reduction (d"(n) plus 
whitened noise w(n)). Through the training process, the equalizers LEQ 105 and DFB 

25 150, and the noise predictor 160, adjust their respective coefficients a(n), b(n) and c(n) to 
minimize the first training error signal 170, el(n), and drive it to zero (approximately). In 
the preferred embodiment, the noise predictor 160 is implemented as a linear adaptive 
filter, and also utilizes a least mean square error algorithm to determine its coefficients 
and minimize the first training error signal 170. 

30 The input into the LEQ 105 is a received and k/T sampled signal, plus the 

first training error signal 170 for adaptation. The input into the DFB 150 is the symbol 
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decision d'(n), plus the first training error signal 170 for adaptation. In accordance with 
the present invention, however, the input to the noise predictor 160 is a second training 
error signal 185, e2(n), which is an error signal formed from the difference between the 
symbol decision (d ! (n)) and the received training signal after only equalization ( d"(n) 
5 plus additive noise nw(n)), prior to any noise whitening (correlated noise reduction). 
(Without the noise predictor 160, el(n) would equal e2(n)). This use of the second 
training error signal e2(n), which includes correlated noise, as input into the noise 
predictor 160, with the adaptation to the first training error signal, generates the 
correlated noise reduction coefficients c(n) of the present invention, for subsequent 

10 correlated noise reduction (noise whitening) during data transmission. 

As mentioned above, following determination of the various equalization 
and correlated noise reduction coefficients a(n), b(n) and c(n) during a training period, 
the coefficients b(n) and c(n) are transferred to a corresponding transmitter, for use as 
Tomlinson coefficients for precoding. The coefficients may be transferred as either 

15 coefficients b(n) and c(n), or as t(n) = b(n) + c(n) + b(n)*c(n). Following these 

determinations and the transfer of coefficients for use in precoding, in the preferred 
embodiment, for low bit error rates in a precoding environment, the c(n) coefficients 
within the noise predictor 160 are reset or re-initialized to zero, to function as new, 
adaptive correlated noise reduction coefficients c f (n) for use during data transmission 

20 mode, as discussed below with reference to Figs. 5. For higher bit error rates, the 

correlated noise reduction coefficients are not reset to zero, and continue to adapt for use 
during data transmission (c"(n) in Fig. 6). In addition, for non-precoding environments, 
another apparatus for correlated noise reduction is illustrated in Fig. 7, for both training 
and data modes. 

25 Figure 5 is a block diagram illustrating a second preferred apparatus 102 

during data transmission mode, with data transmission precoding, in accordance with the 
present invention. As mentioned above, during data transmission mode, the training 
mode adaptive distortion and correlated noise canceller 1 1 0 is no longer used (with the 
b(n) and c(n) coefficients used in transmission-side precoding), and instead, the data 

30 mode adaptive correlated noise canceller 130 is utilized for ongoing adaptation to 

potentially changing noise conditions. The correlated noise reduction coefficients of the 
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noise predictor 160 (within the data mode adaptive correlated noise canceller 130) are 
reset to zero, and for data transmission, are continuously updated to track changes and 
variations in the noise environment over time, and are referred to herein as data mode 
correlated noise reduction coefficients c f (n). The original c(n) coefficients do, however, 
5 continue to be used in filter 120, within the transfer function (1 + C(z)). Modulo function 
blocks 190, 191 and symbol delay block 175 may be implemented as known in the art. 
The structure illustrated in Fig. 5 is used when the bit error rate is generally less than 10" 7 
in the preferred embodiment, to avoid possible divergence of the correlated noise 
reduction coefficients c'(n). In general, for any particular embodiment, a bit error rate 
10 threshold may be determined based upon the amount of coding gain and the amount of 
delay m2. 

For continued adaptation of both the linear feedforward equalizer 105 and 
the noise predictor 160, the preferred apparatus 102 utilizes a trellis error signal (e3(n - 
mi)) 195 from the trellis decoder 140 (which also includes a modulo functionality), and 

15 in addition, utilizes a tentative error signal (e4(n - m2)) 215 for input into the noise 

predictor 160. The parameters mi and ni2 are modifiable, with mi greater than or equal to 
m2, and in the preferred embodiment, mi = m2 = 1, providing trellis and tentative error 
signals having a delay of one unit symbol time period (with symbol delay block 175 also 
providing a unit symbol delay (m 2 =1)). 

20 The selection of the trellis and tentative error signals in a trellis decoding 

environment, in accordance with the present invention, is unique. Utilizing a path having 
a smallest cumulative error within the trellis, the trellis decoder 140 selects a previous 
state, and utilizes the decision error (i.e., current branch metric or branch error), 
corresponding to that selected state to form the trellis error signal (e3(n - mi) 195). More 

25 specifically, the trellis error signal is equal to a branch or decision error (or 

branch/decision metric) of a previous state, with the previous state selected from the path 
(or trace) having the smallest cumulative error. As known in the art, and in the preferred 
embodiment, such a decision or branch error is determined as the square of the absolute 
value of the difference between the received data signal (after equalization and correlated 

30 noise reduction) and a selected constellation point. For example, in the event of a 

received data signal (after equalization and correlated noise reduction) equal to —4.328 V 
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and a selected constellation point of -5 V, the branch or decision error (or metric) would 
be equal to I -4.328 + 5 | 2 . There are myriad other equivalent methods which may be 
utilized to determine the branch or decision error, however. In addition, in the preferred 
embodiment, the selected state is an immediately previous state on the path having the 
5 least cumulative error (selected at time t = (n - 1), i.e., m\ = 1). Both the LEQ 105 and 
the noise predictor 160 (with data mode correlated noise reduction coefficients c f (n)) 
adapt to the trellis error signal, attempting to force the branch or decision error, of 
previous states along the minimum error path (minimum cumulative error), to zero 
(approximately). While mi = 1 in the preferred embodiment, in general, mi is selected as 

10 a compromise between accuracy and adaptation rate, as when mi is larger, error is less, 
but delay is increased and the adaptation rate is slower. 

The tentative error signal (e4(n - m 2 ) 215) is a tentative decision error, and 
is formed similarly to the second training error signal, but having a delay of one symbol 
time in the preferred embodiment. More particularly, the tentative error signal is formed 

15 as a difference between a tentative symbol decision at time t = (n - m2), d f (n - m 2 ) 
(preferably with m 2 = 1), as output from the trellis decoder 140, and the received data 
signal subsequent to equalization and filtering, and prior to additional noise whitening (as 
output from filter 120, with a corresponding delay of one symbol time period from 
symbol delay block 175 (with m 2 = 1) and modulo function block 190). While m 2 = 1 in 

20 the preferred embodiment, in general, m 2 is selected as a compromise between accuracy 
of the tentative decisions and the ability to remove correlations between nearby samples, 
as when m 2 is larger, error may be less, but correlations cannot be cancelled between 
samples that are separated by less than m 2 + 1. 

Of particular significance, utilizing the various apparatuses 102, 103 (Fig. 

25 6) or 104 (Fig. 7) during data transmission mode, in accordance with the present 

invention, to update the equalization and correlated noise reduction coefficients a(n) and 
c(n) (or c'(n) or c M (n)), avoids a problem typically encountered in the prior art. In the 
prior art, the various data communication devices must retrain in the event of changing 
noise conditions, resulting in ceasing data transmission, training again, followed by 

30 resuming data transmission. With the coefficient update provided during data 
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transmission mode with the present invention, such prior art retraining is avoided, with 
data transmission effectively continuing uninterrupted. 

Figure 6 is a block diagram illustrating a third preferred noise canceller 
apparatus 103 during data transmission mode, with data transmission precoding, in 
5 accordance with the present invention. The structure illustrated in Fig. 6, utilizing data 
mode adaptive correlated noise canceller 130A (with noise predictor 160) and bypassing 
(1 + C(z)) filter 120 (of Figs. 1 and 5), is used when the bit error rate is generally greater 
than 10" , as it is not sensitive to feedback decision error and provides an alternative 
means of adaptation to track error which may be introduced, for example, due to 

10 temperature variations. In this case, the correlated noise reduction coefficients c(n) of the 
noise predictor 160 (within the data mode adaptive correlated noise canceller 13 OA) are 
not reset to zero; for data transmission, the correlated noise reduction coefficients are 
continuously updated to track changes and variations in the noise environment over time, 
as data mode correlated noise reduction coefficients c"(n). As in the structure of Fig. 5, 

15 the LEQ 105 and noise predictor 160 adapt to the trellis error signal, attempting to force 
the branch or decision error, of previous states along the minimum error path (minimum 
cumulative error), to zero. No tentative error signal is utilized in this. embodiment, and 
instead, the input to the noise predictor 160 is the received signal after equalization by 
LEQ 105. Alternatively in this embodiment, the adaptation of noise predictor 160 may 

20 be held constant (static), with the noise predictor 160 used to implement a finite impulse 
response (FIR) filter. 

Figure 7 is a block diagram illustrating a fourth noise canceller apparatus 
104 for additional, non-precoding data communications applications, in accordance with 
the present invention. The apparatus 104 may be utilized during both training and data 

25 transmission modes, and in trellis encoded applications. In non-precoding data 

communications applications, DFB 150 is not utilized and, as a consequence, in the 
preferred embodiment, noise predictor 160 may be implemented as a longer adaptive 
filter. In addition, during data transmission mode, (1 + C(z)) filter 120 is not utilized. 

During a training period, both LEQ 105 and noise predictor 160 adapt to 

30 the first training error signal el(n) 170, with the second training error signal (e2(n - 1112)) 
185 providing input into the noise predictor 160, generating equalization and correlated 
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noise reduction coefficients a(n) and c(n), respectively. The second training error signal 
(e2(n - m 2 )) 185 is a delayed error signal, where the delay ni2 (of blocks 175 and 176) 
matches the trellis 140 look-back depth of the data mode. Following such training, the 
correlated noise reduction coefficients c(n) of the noise predictor 160 are not reset to 
5 zero; for data transmission, the correlated noise reduction coefficients are continuously 
updated to track changes and variations in the noise environment over time. During data 
transmission mode (dashed lines), both LEQ 105 and noise predictor 160 adapt to the 
trellis error signal e3(n - mi) 195, with a fifth error signal e5(n - m 2 ) 216 providing input 
into the noise predictor 160. As in Fig. 5, the trellis error signal 195 is also is equal to a 

10 branch or decision error (or branch metric) of a previous state, with the (immediately (mi 
= 1)) previous state selected by trellis decoder 140 from the path (or trace) having the 
smallest cumulative error. The fifth error signal 216 is formed similarly to the tentative 
error signal, differing insofar as filter 120 and corresponding modulo function 190 are not 
implemented in apparatus 104. More particularly, the fifth error signal is also formed as 

1 5 a difference between a tentative symbol decision at time t = (n - 1112), d'(n - m 2 ) (with m 2 
= 1), as output from the decoder 140, and the received data signal subsequent to 
equalization (as output from LEQ 105 and sampler 125, but prior to additional noise 
whitening) also with a corresponding delay of m 2 symbol time periods from symbol delay 
block 175 (preferably with m 2 = 1)). As a consequence, the fifth error signal 216 and the 

20 tentative error signal 215 are functionally equivalent, and may be considered 
interchangeable herein. 

Figure 8 is a block diagram illustrating a preferred data communication 
device embodiment 400 of the noise canceller apparatus in accordance with the present 
invention. The data communication device 400 is typically coupled or connected via a 

25 channel 305 to a network, which may be any type of network, such as a local loop or a 
public switched telephone network (PSTN), which provides further connections to other 
data communication devices. The channel 305 is preferably one or more twisted pairs of 
copper wire, but also may be any other type of medium, such as coaxial cable or fiber 
optic cable. The data communication device 400 receives and transmits encoded (and 

30 modulated) data, respectively from and to one or more other data communication devices, 
via a network. 
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The data communication device 400 includes a network interface 415, a 
processor 410, a memory 420, a transmitter (with precoder) 430, a system interface 440, 
equalizers LEQ 105 and DFB 150, and noise predictor 160. The equalizers LEQ 105 and 
DFB 150, the noise predictor 160, and the processor 410, in the preferred embodiment, 
5 implement or embody the apparatus (450) of the present invention. The apparatus 450, 
with the network interface (comprising a receiver), with the transmitter 430, comprise a 
system of the present invention. The network interface 415 is utilized to receive and 
transmit information and other data, control messages, and other pertinent information, to 
and from a network, and is typically designed to interface with a selected type of channel 

10 305 (such as twisted pair). Depending upon the data communication protocol to be 

implemented, the network interface 415 may also include a modulator and a demodulator, 
such as to implement quadrature amplitude modulation. The system interface 440 is 
utilized to communicate with a user device, such as a computer or a local area network, 
and provides decoded data to a user device or receives data for transmission. The data 

15 communication device 400 also includes a transmitter (with a precoder) 430, as discussed 
above. For non-precoding environments, such as for the structure of Fig. 7, transmitter 
430 may be implemented without a precoder. 

The data communication device 400 also includes a processor 410 and a 
memory 420. The memory 420 is preferably an integrated circuit (such as random access 

20 memory (RAM) in any of its various forms), but also may be a magnetic hard drive, an 
optical storage device, or any other type of data storage apparatus. The memory 420 is 
used to store information obtained during the correlated noise reduction process, such as 
the various correlated noise reduction and equalization coefficients a(n), b(n), c(n), and 
c'(n) or c"(n), the Tomlinson coefficients t(n), other information utilized within the 

25 decoding process, such as path and branch metrics, and also may store information 
pertaining to program instructions or configurations, if any (discussed below). The 
equalizers LEQ 105 and DFB 150, and the noise predictor 160, are implemented as 
discussed above. 

Continuing to refer to Fig. 8, the processor 410 may include a single 
30 integrated circuit ("IC"), or may include a plurality of integrated circuits or other 

components connected, arranged or grouped together, such as microprocessors, digital 



-21 - 



# • 

signal processors ("DSPs"), custom ICs, application specific integrated circuits 
("ASICs"), field programmable gate arrays ("FPGAs"), associated memory (such as 
RAM and ROM), and other ICs and components. As a consequence, as used herein, the 
term processor should be understood to equivalently mean and include a single IC, or 
5 arrangement of custom ICs, ASICs, processors, microprocessors, controllers, FPGAs, or 
some other grouping of integrated circuits which perform the functions discussed above 
with reference to Figs. 1-7, and also discussed below with reference to Fig. 9, with 
associated memory, such as microprocessor memory or additional RAM, DRAM, 
SRAM, MRAM, ROM, EPROM or E 2 PROM. The processor 410 with its associated 

10 memory may be configured (via programming or hard-wiring) to perform the 

methodology of the invention, as discussed above with reference to Figs. 1-7, and as 
discussed below with reference to Fig. 9. For example, the methodology may be 
programmed and stored, in the processor 410 with its associated memory (and/or memory 
420) and other equivalent components, as a set of program instructions (or equivalent 

15 configuration or other program) for subsequent execution when the processor 410 is 

operative (i.e., powered on and functioning). Equivalently, when the processor 410 with 
its associated memory and other equivalent components are implemented in whole or part 
as FPGAs, custom ICs and/or ASICs, the FPGAs, custom ICs or ASICs also may be 
designed, configured and/or hard-wired to implement the methodology of the invention. 

20 In the preferred embodiment, the processor 410 may be implemented in its entirety as an 
ASIC and/or as a DSP, which are configured (hard-wired) through its design (such as 
gate and interconnection layout) and/or program instructions to implement the 
methodology of the invention, and to include the memory 420. In the preferred 
embodiment, the functions performed by the processor 410 may include trellis decoding 

25 (trellis decoder 140), symbol decision (slicing) during training (symbol decider 165 of 
trellis decoder 140), all of the various mathematical functions such as the addition 
(summer 135) and multiplication steps discussed above (e.g., functions of the summer 
135,(1 + C(z)) filter 120, the determination of Tomlinson coefficients t(n) = b(n) + c(n) + 
b(n)*c(n)), modulo and delay functions, path and branch metric determination, and all 

30 other digital signal processing functions which may occur in the equalization and 
correlated noise reduction functions discussed above. 
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Figure 9 is a flow diagram illustrating a method of correlated noise 
reduction, during both training and data modes, in accordance with the present invention, 
and provides a useful summary. The method begins, start step 500, with the reception of 
a training signal having noise and ISI, with the noise being, for example, additive noise. 
5 As indicated above, such noise typically has a significant correlated portion, from sources 
such as crosstalk and residual echo. In step 505, the method determines a plurality of 
linear feedforward equalization coefficients a(n), with the received training signal as 
input, preferably utilizing a k/T sample rate, and adapting to a first training error signal, 
predominantly for pre-cursor equalization and ISI reduction. As indicated above, in the 

10 preferred embodiment, the first training error signal is formed as a difference between a 
symbol decision and a received signal subsequent to equalization and correlated noise 
reduction. When precoding is to be utilized, step 510, the method proceeds to step 515 
and determines a plurality of decision feedback equalization coefficients b(n), preferably 
utilizing a 1/T sample rate, the symbol decision as input, and also adapting to the first 

15 training error signal, predominantly for post-cursor equalization and ISI reduction. When 
precoding is not to be utilized in step 510, the method does not implement step 515, 
proceeding to step 520. In step 520, the method determines a plurality of correlated noise 
reduction coefficients c(n), preferably utilizing a 1/T sample rate, adapting to a first 
training error signal, and using a second training error signal as input, with the second 

20 training error signal formed by a difference between a symbol decision and a received 
symbol subsequent to equalization (but prior to any correlated noise reduction), step 520. 
While a training period is in progress, step 525, the method returns to step 505, for 
repeated iterations of steps 505, 510, 515 and 520. While for ease of reference in Fig. 9, 
steps 505, 515 and 520 are illustrated in a sequence, it should be noted that in the 

25 preferred embodiment, the adaptation periods for the coefficient determination steps 505, 
515 and 520 overlap in time. More specifically, coefficient determination steps 505, 515 
and 520 preferably occur concurrently, with continued adaptation of the coefficients a(n), 
b(n) and c(n) occurring concurrently and, in general, not independently. 

When the training period is completed in step 525, and when precoding is 

30 to be utilized (step 530), the method determines a plurality of correlated noise reduction 
and equalization coefficients (Tomlinson coefficients) for transmission-side precoding, as 
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t(n) = b(n) + c(n) + b(n)*c(n), and for bit error rates less than 10" 7 , resets the correlated 
noise reduction coefficients c(n) to zero, step 535. As mentioned above, the 
determination of Tomlinson coefficients may be performed by either a transmitter or a 
receiver. Following step 535, or when precoding is not to be utilized (step 530), the 
5 method proceeds to step 540, in which data is received from another transmitter and is 
trellis decoded. The data may or may not be precoded with the correlated noise reduction 
and equalization coefficients t(n). As the data is being trellis decoded, the method 
determines and selects a trellis path (or trace) having a smallest or least cumulative error, 
step 545. Next, the method determines a decision (or branch) error, associated with a 
10 selected previous state of the selected trellis path, to form a trellis error signal, step 550. 
As mentioned above, in the preferred embodiment, an immediately previous state is 
selected from the trellis path having the least cumulative error (i.e., the previous state at 
time t = (n - 1)), and its associated or corresponding decision (or branch) error forms the 
trellis error signal. 

15 Continuing to refer to Fig. 9, following step 550, the method then updates 

the linear feedforward equalization coefficients a(n), with adaptation to the trellis error 
signal, step 555, and updates the correlated noise reduction coefficients, with adaptation 
to the trellis error signal, and with input of a tentative error signal, step 560. As 
mentioned above, the tentative error signal is a tentative decision error, formed as a 

20 difference between a tentative symbol decision (d f (n - m2)), preferably with m2 = 1, and 
the received data signal subsequent to equalization (and filtering, for various 
embodiments). As a consequence, the linear feedforward equalization coefficients a(n) 
and the correlated noise reduction coefficients c(n) (or as c'(n) or c"(n)), are allowed to 
update in response to potentially changing noise conditions. While the communication 

25 session is in progress, step 565, the method returns to step 540, to receive and decode 

trellis encoded data, determine the trellis and tentative error signals, and update the linear 
feedforward equalization coefficients and correlated noise reduction coefficients. 
Following completion of the data communication session, step 565, the method may end, 
return step 570. 

30 Figure 10 is a graph diagram illustrating, as a simplified example, 

improved performance and reduced sheer error utilizing the correlated noise reduction 
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apparatus of the present invention, with sheer error (in dB) (on the ordinate axis) graphed 
as a function of frequency (on the abscissa axis), for a symbol rate of 500,000 symbols 
per second. Without a correlated noise reduction apparatus of the present invention, 
correlated crosstalk results in a "non-flat" slicer error power spectral density (PSD), 
5 illustrated as line 600 in Figure 10 (solid line). With the addition of the correlated noise 
reduction apparatus of the present invention (with the equalization configuration of LEQ 
105 and DFB 150, with noise predictor 160, as illustrated in Fig. 4), the slicer error PSD 
can be "flattened", illustrated as line 605 in Figure 10 (dot-dash line). This "flatter" slicer 
error PSD lowers the average slicer error power, thereby providing an improved SNR 

1 0 (signal to noise ratio). 

Figure 1 1 is an exemplary graph diagram illustrating improved 
performance and reduced symbol error rate under various conditions utilizing the 
correlated noise reduction apparatus of the present invention, with symbol error rate 
(SER) (on the ordinate axis) graphed as a function of slicer SNR (on the abscissa axis). 

15 Line 610 illustrates an ideal situation, that of SER v. slicer SNR for 512-state trellis 
coding with ideal white Gaussian noise. Conversely, at the other extremes, line 630 
illustrates SER v. slicer SNR with no trellis coding but having ideal white Gaussian 
noise, while line 625 illustrates SER v. slicer SNR with 512-state trellis coding using 1- 
step delayed decision with correlated noise. Illustrating coding gain under conditions of 

20 correlated noise, line 620 illustrates SER v. slicer SNR for 512-state trellis coding with 
correlated noise but without a correlated noise reduction apparatus of the present 
invention. Lastly, illustrating additional improved performance beyond coding gain, line 
615 illustrates SER v. slicer SNR for 512-state trellis coding with correlated noise and 
with a correlated noise reduction apparatus of the present invention. Apparent from Fig. 

25 11, the coding gain of the 5 12-state trellis code is only approximately 4 dB when the 
noise is not white. When the correlated noise reduction apparatus of the present 
invention is used, however, the coding gain of the 512-state trellis code is improved to 
nearly 5 dB. As a consequence, the performance margin, as measured at SER = 10" 7 , may 
be improved as much as 1 dB with the correlated noise reduction apparatus of the present 

30 invention, in addition to the higher average slicer SNR. 
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